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Objective: To validate a simple scoring system to classify dengue viral infection severity to 
patients in different settings. 

Methods: The developed scoring system derived from 777 patients from three tertiary-care 
hospitals was applied to 400 patients in the validation data obtained from another three tertiary- 
care hospitals. Percentage of correct classification, underestimation, and overestimation was 
compared. The score discriminative performance in the two datasets was compared by analysis 
of areas under the receiver operating characteristic curves. 

Results: Patients in the validation data were different from those in the development data in 
some aspects. In the validation data, classifying patients into three severity levels (dengue fever, 
dengue hemorrhagic fever, and dengue shock syndrome) yielded 50.8% correct prediction 
(versus 60.7% in the development data), with clinically acceptable underestimation (18.6% 
versus 25.7%) and overestimation (30.8% versus 13.5%). Despite the difference in predictive 
performances between the validation and the development data, the overall prediction of the 
scoring system is considered high. 

Conclusion: The developed severity score may be applied to classify patients with dengue 
viral infection into three severity levels with clinically acceptable under- or overestimation. Its 
impact when used in routine clinical practice should be a topic for further study. 
Keywords: dengue hemorrhagic fever, dengue shock syndrome, validation, clinical 
prediction rule 

Introduction 

Dengue viral infection is one of the most challenging tropical diseases internationally. 1 
The infection may be complicated with hypotension 2 and bleeding abnormality, 
leading to high mortality. 2,3 The infection also has high economic impact due to high 
cost of care. 4,5 Prognostication of disease severity may help clinicians decide which 
patients should be admitted to hospital, or which patients may safely be treated as 
outpatients. 6 

A clinical decision rule is a clinical tool that quantifies the individual contributions 
that various components of the history, physical examination, and basic laboratory 
results make toward the diagnosis, prognosis, or likely response to treatment in a 
patient. Clinical decision rules attempt to formally test, simplify, and increase the 
accuracy of clinicians' diagnostic and prognostic assessments. 7 

A prediction rule for severe dengue infection based on clinical signs and simple labo- 
ratory results was successful in predicting dengue hemorrhagic fever (DHF) and dengue 
shock syndrome (DSS). 8 Decision tree algorithms, 9 " 12 diagnostic decision algorithms, 13 
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the pediatric logistic organ dysfunction score, 14-18 and the 
disseminated intravascular coagulation scoring system 19,20 
were also developed. Other studies were also designed to 
differentiate dengue fever (DF), 910 types of dengue infection 
(DF, DHF, or DSS), 101213 fatal conditions, 12 development of 
DHF, 11 multiple organ dysfunctions, 14 " 16 DSS mortality, 1718 
and disseminated intravascular coagulation. 19,20 

Earlier, we developed a scoring system to help screen 
patient severity 21 based on clinical parameters and simple 
laboratory tests. The present study was conducted to exter- 
nally validate this scoring system to patients in different 
settings. 

Materials and methods 

Patients 

Medical files of patients with dengue viral infection aged 
1-15 years were retrieved from hospital database, all cases 
were included in the study. The following International 
Classification of Diseases (ICD)-IO codes were used: A-90 
(DF), A-91 (DHF), and A-910 (DHF with shock). 

Definition of dengue seventy 

The severity of dengue infection was defined by the following 
criteria, as in the previous study. 21 

1 . Dengue infection - acute or abrupt onset of fever, accom- 
panied by a positive tourniquet test, and white blood count 
<5,000/liL 22 

2. DHF - all items of the following: 23 

• Acute or abrupt fever for 2-7 days 

• At least one of the following bleeding episodes: 

- Positive tourniquet test 

- Petechiae, ecchymoses, or purpura 

- Bleeding from mucosa, gastrointestinal tract, injec- 
tion sites, or other location 

- Hematemesis or melena 

• Platelets <100,000/uL 

• At least one of the following plasma leakage 
evidences: 

- Hemoconcentration assessed by an increase in 
hematocrit >20% from previous hematocrit 

- Signs of plasma leakage, such as pleural effusion 
or ascites, or an evidence of hypoalbuminemia 

3. DSS - all items for DHF above, accompanied with evi- 
dence of circulatory failure, such as: 23 

• Rapid and weak pulse; and 

• Pulse pressure ^20 mmHg. 
Or manifested by: 

• Hypotension; and 

• Cold body temperature or irritability. 



Table I Score assignment scheme for classifying dengue severity 



Clinical characteristic 


Criteria 


Assigned score 


Age, years 


>6 


1 




<6 


0 


Hepatomegaly 


Yes 


8.5 




No 


0 


Systolic blood pressure, mmHg 


<90 


2 




>90 


0 


White cell count, /|iL 


>S,000 


1 




<S,000 


0 


Platelets, /|lL 


<S0,000 


4.5 




>S0,000 


0 



Notes: Modified from Pongpan S, Wisitwong A, Tawichasri C, Patumanond J. 
Prognostic indicators for dengue infection severity. Int J Gin Pediatr. 20 1 3;2(l): 12-1 8. 8 
Copyright © 20 1 3 Surangrat Pongpan et al. 



Table 2 Clinical characteristics of dengue patients in the 
development and the validation data 

Characteristics Development Validation P-value* 

(n=777) (n=400) 

Mean ± SD Mean ± SD 



Demographic 



Male, n (%) 


376 (48.4) 


223 (55 8) 


0 019 


Age, years 


9.6±3.3 


1 0 3+3 4 


0.002 


Mode of presentation, n (%) 






Hepatomegaly 


07 ^ 1 1 . D) 


II O ff\ 


^n nn 


Headache 


408 (52.5) 


301 (75.3) 


^n nn 


Myalgia 


126 (16.2) 


1 LA /A 1 f\\ 
1 64 [4 1 .U) 


<0.00 


Vomiting 


516 (66.4) 


255 (63.8) 


0.366 


Cough 


246 (31.7) 


142 (35.5) 


0|9| 


Abdominal pain 


401 (51.6) 


158 (39.5) 


<0.00 


Rash 


324 (41.7) 


254 (63.5) 


<0.00 


Pleural effusion 


54 (7.0) 


16 (4.0) 


0.030 


Petechiae 


67 (8.6) 


76 ( 1 9.0) 


<0.00 


Any bleeding episodes 


204 (26.3) 


121 (30.3) 


0.149 


Hemodynamic 








SBP, mmHg 


95.9±I0.0 


96.2±I0.0 


0.208 


DBP, mmHg 


58.3±8.2 


58.5±7.5 


0.270 


Pulse pressure, mmHg 


3I.0±8.0 


32.6±20. 1 


<0.00 


Hematological 








Hematocrit, (%) 


40.3±5.0 


40.3±5.2 


0.781 


Hemoglobin, g/dL 


I3.l±l.6 


I3.0±l.7 


0.044 


White cell count, /ul 


4,I7I.5± 


3,6I2.4± 


<0.00 




1,800.3 


1,202.1 




Lymphocytes, (%) 


42.7±I6.7 


40.8±I5.4 


0.003 


Neutrophils, (%) 


47.1 ±18.5 


43.6±I9.0 


<0.00 


Platelets, /ul 


97,569.5± 


1 1 l,963.2± 


<0.00 




8,707.0 


6,692.2 




Biochemical 








AST, IU/L 


35l.7±522.7 


477.5±437.0 


0.152 


ALT, IU/L 


1 35.8±324.9 


1 8 1 .0+269. 1 


0.048 


PT, seconds 


1 3.7±6.8 


1 3.3±2.8 


0.796 


PTT, seconds 


42.0±l 1.5 


36.4±9.l 


0.094 


Case management, n (%) 








Inbound referral 


169 (21.8) 


54 (13.5) 


0.001 


Discharged 








Alive 


775 (99.7) 


400 (100.0) 


0.551 


Outbound referral 


2 (0.3) 


0(0) 




Died in hospital 


0(0) 


0(0) 





Note: *P-value from exact probability test or t-test or Wilcoxon's rank sum test. 
Abbreviations: ALT, alanine aminotransferase; AST, aspartate aminotransferase; 
DBP, diastolic blood pressure; PT, prothrombin time; PTT, partial thromboplastin 
time; SBP, systolic blood pressure; SD, standard deviation. 
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Table 3 Score-derived dengue severity levels in the development 
and the validation data 



Score-classified 


Development 


Validation 


P-value 


severity levels 


(n=777) 


(n=400) 




Mean score (± SD) 


5.6+4.1 


4.2±2.5 


<0.00l 


Range 


0-18 


0-18 




Severity levels, n (%) 








DF 


451 (58.0) 


133 (33.3) 


<0.00l* 


DHF 


276 (35.5) 


261 (65.3) 




DSS 


50 (6.4) 


6(1.5) 





Note: *P-value from non-parametric test for trend. 

Abbreviations: DF, dengue fever; DHF, dengue hemorrhagic fever; DSS, dengue 
shock syndrome; SD, standard deviation. 



Development data 

The original data used to develop the score were obtained 
from three university-affiliated tertiary-care hospitals in 
Nakorn Sawan, Kampaeng Phet, and Uttaradit between 2007 
and 2010(n=777). 

Validation data 

The validation data were from similar patients as in the 
development data in another three university-affiliated 
tertiary-care hospitals in Phrae, Lamphun, and Chiang Mai 
during the same period (n=400). 

Data analysis 

The development data and the validation data were compared 
by exact probability tests or Student's f-tests or Wilcoxon's 
rank sum tests. The severity score was assigned to the patients 
based on the scoring system proposed from the earlier 
study, analyzed by multivariable ordinal logistic regression. 
Assigned item scores were derived by transformation of 
the coefficients of parameters (Table l). 21 The proportions 
if correct prediction, underestimation, and overestimation 
in the development and the validation data were compared 
by areas under the receiver operating characteristic curves 



(AuROC). The predictive ability of the scoring system of 
both datasets was graphically compared by the probability 
or risk curves. 

Results 

Patients in the development and the validation data were 
similar in the presence of the following symptoms and signs: 
vomiting, cough, bleeding, systolic blood pressure, diastolic 
blood pressure, hematocrit, aspartate aminotransferase, 
prothrombin time, partial thromboplastin time, but were 
different in gender, age, hepatomegaly, headache, myalgia, 
abdominal pain, rash, pleural effusion, petechiae, pulse 
pressure, hemoglobin, white cell count, lymphocytes, neu- 
trophils, platelets, and alanine aminotransferase (Table 2). 

The severity score of patients in the development data was 
higher than in those in the validation data (5.6+4.1 versus 
4.2+2.5, P<0.001), and the percentage of DSS was higher 
(6.4% versus 1.5%, P<0.001) (Table 3). 

In the validation data, classification of patients into three 
severity levels (DF, DHF, and DSS) yielded the following 
results. 

• Patients scoring less than 2.5 predicted DF correctly in 
21 .5% (n=86 from 208), with 1 -level underestimation in 
11% (n=44) and 2-level underestimation in 0.8% (n=3), 
a total of 11.8% (n=47). 

• Scores 2.5-11.5 predicted DHF correctly in 28.0% 
(n=112 from 157), with an underestimation in 6.8% 
(n=27) and an overestimation in 30.5% (n=122). 

• Scores above 11.5 predicted DSS correctly in 1 .3% (n=5 
from 35), with only 1-level overestimation in 0.3% (n=l) 
(Table 4). 

A total correct prediction was obtained in 50.8% 
(versus 60.7% in the development data), with an overall 
underestimation of 18.6% (versus 25.7%) and an overall 
overestimation in 30.8% (versus 13.5%). 



Table 4 Score-classified severity and criterion-classified dengue severity in the validation data 


Score-classified 


Score range 


Criterion-classified severity levels 


Risk estimation validity* 




severity levels 




DF 


DHF 


DSS 


Over 


Correct 


Under 






n=208 


n=l57 


n=35 


(%) 


(%) 


(%) 


Mean ± SD 




3.3±l.8 


4.4±2.l 


6.5±3.5 








IQR 




2.0^1.8 


3.8-4.8 


4.8-6.8 








DF 
















n=l33 


<2.5 


86 


44 


3 




21.5 


1 1.8 


DHF 
















n=26l 


2.5-1 1.5 


122 


1 12 


27 


30.5 


28.0 


6.8 


DSS 
















n=6 


>l 1.5 


0 


1 


5 


0.3 


1.3 












Total 


30.8 


50.8 


18.6 



Note: ^Percentage of total patients. 

Abbreviations: DF, dengue fever; DHF, dengue hemorrhagic fever; DSS, dengue shock syndrome; IQR, interquartile range; SD, standard deviation. 
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Table 5 Discriminative performance of the dengue severity score in the development data and the validation data 



Prediction/discrimination 


Development (n= 


=777) 


Validation (n=400) 




P-value 




AuROC (%) 


95% CI 


AuROC (%) 


95% CI 




DHF and DSS versus DF 
DSS versus DF and DHF 


74.17 
88.77 


72.94-75.37 
87.88-89.64 


70.76 
75.91 


68.83-72.43 
74.18-77.57 


0.003 
<0.00l 



Abbreviations: AuROC, area under receiver operating characteristic curve; CI, confidence interval; DF, dengue fever; DHF, dengue hemorrhagic fever; DSS, dengue shock 
syndrome. 



The ability of the score to discriminate DF from DHF 
and DSS was different between the development and the 
validation data (AuROC =74. 1 7% versus 70.76%, P=0.003). 
The ability to discriminate DSS from DF and DHF was also 
different (AuROC =88.77% versus 75.91%, P<0.001), as 
shown in Table 5 and Figure 1 . 

Discussion 

The scoring systems for dengue infection in the past were 
reported to be successful when validated. 24 A simple decision 
tree using existing data was also successful as a guideline 
to admit DHF patients into hospitals, reducing unnecessary 
admission of mild DF. 25 A probability equation and a decision 
tree for DHF derived in 2004 and internally validated in 2007 
was also successful in predicting DHF at first presentation, 
avoiding unnecessary hospital admission. 26 

The scoring system proposed in the prior study 21 was less 
accurate when validated to the new patients. This reduced 
accuracy may have occurred due to the fact that patients in 
the validation data were more severe or less severe than the 
development data, such as seen in this study. 

However, from a clinical perspective, this scoring system 
would be useful in routine practice, as it requires only simple 
clinical data which can be obtained routinely and is usually 
available in all levels of patient care centers. 
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Figure I Score-predicted probability of severity in the development data (solid 
lines) and the validation data (dashed lines). Vertical dotted lines represent score- 
derived criteria for classifying patients into DF, DHF, and DSS. 
Abbreviations: DF, dengue fever; DHF, dengue hemorrhagic fever; DSS, dengue 
shock syndrome. 



When applied to clinical practice, patients with a low 
score who are likely to have DF could be treated as outpa- 
tients, while those with a higher score who are likely to have 
DHF could be admitted, and those with the highest score 
who are likely to have DSS should be admitted for close 
monitoring, such as in an intensive care unit. 

An impact of application of the score into routine clinical 
practice should be studied further to confirm its usefulness. 

Conclusion 

Despite some difference between patients in the validation 
and in the development data, the scoring system could still 
discriminate dengue infection severity with clinically accept- 
able over- or underestimation. The proposed scoring system 
is likely to be generalized and applied to routine practice in 
similar patients and settings. 
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